Multiple objects evoke fluctuating responses in several regions of the visual pathway.

How neural representations preserve information about multiple stimuli is mysterious. Because tuning of individual neurons is coarse (e.g., visual receptive field diameters can exceed perceptual resolution), the populations of neurons potentially responsive to each individual stimulus can overlap, raising the question of how information about each item might be segregated and preserved in the population. We recently reported evidence for a potential solution to this problem: when two stimuli were present, some neurons in the macaque visual cortical areas V1 and V4 exhibited fluctuating firing patterns, as if they responded to only one individual stimulus at a time (Jun et al., 2022). However, whether such an information encoding strategy is ubiquitous in the visual pathway and thus could constitute a general phenomenon remains unknown. Here, we provide new evidence that such fluctuating activity is also evoked by multiple stimuli in visual areas responsible for processing visual motion (middle temporal visual area, MT), and faces (middle fundus and anterolateral face patches in inferotemporal cortex - areas MF and AL), thus extending the scope of circumstances in which fluctuating activity is observed. Furthermore, consistent with our previous results in the early visual area V1, MT exhibits fluctuations between the representations of two stimuli when these form distinguishable objects but not when they fuse into one perceived object, suggesting that fluctuating activity patterns may underlie visual object formation. Taken together, these findings point toward an updated model of how the brain preserves sensory information about multiple stimuli for subsequent processing and behavioral action.

Specialized Networks for Social Cognition in the Primate Brain.

Primates have evolved diverse cognitive capabilities to navigate their complex social world. To understand how the brain implements critical social cognitive abilities, we describe functional specialization in the domains of face processing, social interaction understanding, and mental state attribution. Systems for face processing are specialized from the level of single cells to populations of neurons within brain regions to hierarchically organized networks that extract and represent abstract social information. Such functional specialization is not confined to the sensorimotor periphery but appears to be a pervasive theme of primate brain organization all the way to the apex regions of cortical hierarchies. Circuits processing social information are juxtaposed with parallel systems involved in processing nonsocial information, suggesting common computations applied to different domains. The emerging picture of the neural basis of social cognition is a set of distinct but interacting subnetworks involved in component processes such as face perception and social reasoning, traversing large parts of the primate brain.

Encoding of dynamic facial information in the middle dorsal face area.

Faces in motion reveal a plethora of information through visual dynamics. Faces can move in complex patterns while transforming facial shape, e.g., during the generation of different emotional expressions. While motion and shape processing have been studied extensively in separate research enterprises, much less is known about their conjunction during biological motion. Here, we took advantage of the discovery in brain-imaging studies of an area in the dorsal portion of the macaque monkey superior temporal sulcus (STS), the middle dorsal face area (MD), with selectivity for naturalistic face motion. To gain mechanistic insights into the coding of facial motion, we recorded single-unit activity from MD, testing whether and how MD cells encode face motion. The MD population was highly sensitive to naturalistic facial motion and facial shape. Some MD cells responded only to the conjunction of facial shape and motion, others were selective for facial shape even without movement, and yet others were suppressed by facial motion. We found that this heterogeneous MD population transforms face motion into a higher dimensional activity space, a representation that would allow for high sensitivity to relevant small-scale movements. Indeed, we show that many MD cells carry such sensitivity for eye movements. We further found that MD cells encode motion of head, mouth, and eyes in a separable manner, requiring the use of multiple reference frames. Thus, MD is a bona fide face-motion area that uses highly heterogeneous cell populations to create codes capturing even complex facial motion trajectories.

Joint encoding of facial identity, orientation, gaze, and expression in the middle dorsal face area.

The last two decades have established that a network of face-selective areas in the temporal lobe of macaque monkeys supports the visual processing of faces. Each area within the network contains a large fraction of face-selective cells. And each area encodes facial identity and head orientation differently. A recent brain-imaging study discovered an area outside of this network selective for naturalistic facial motion, the middle dorsal (MD) face area. This finding offers the opportunity to determine whether coding principles revealed inside the core network would generalize to face areas outside the core network. We investigated the encoding of static faces and objects, facial identity, and head orientation, dimensions which had been studied in multiple areas of the core face-processing network before, as well as facial expressions and gaze. We found that MD populations form a face-selective cluster with a degree of selectivity comparable to that of areas in the core face-processing network. MD encodes facial identity robustly across changes in head orientation and expression, it encodes head orientation robustly against changes in identity and expression, and it encodes expression robustly across changes in identity and head orientation. These three dimensions are encoded in a separable manner. Furthermore, MD also encodes the direction of gaze in addition to head orientation. Thus, MD encodes both structural properties (identity) and changeable ones (expression and gaze) and thus provides information about another animal's direction of attention (head orientation and gaze). MD contains a heterogeneous population of cells that establish a multidimensional code for faces.

A fast link between face perception and memory in the temporal pole.

The question of how the brain recognizes the faces of familiar individuals has been important throughout the history of neuroscience. Cells linking visual processing to person memory have been proposed but not found. Here, we report the discovery of such cells through recordings from an area in the macaque temporal pole identified with functional magnetic resonance imaging. These cells responded to faces that were personally familiar. They responded nonlinearly to stepwise changes in face visibility and detail and holistically to face parts, reflecting key signatures of familiar face recognition. They discriminated between familiar identities, as fast as a general face identity area. The discovery of these cells establishes a new pathway for the fast recognition of familiar individuals.

Evolutionary and biomedical insights from a marmoset diploid genome assembly.

The accurate and complete assembly of both haplotype sequences of a diploid organism is essential to understanding the role of variation in genome functions, phenotypes and diseases1. Here, using a trio-binning approach, we present a high-quality, diploid reference genome, with both haplotypes assembled independently at the chromosome level, for the common marmoset (Callithrix jacchus), an primate model system that is widely used in biomedical research2,3. The full spectrum of heterozygosity between the two haplotypes involves 1.36% of the genome-much higher than the 0.13% indicated by the standard estimation based on single-nucleotide heterozygosity alone. The de novo mutation rate is 0.43 × 10-8 per site per generation, and the paternal inherited genome acquired twice as many mutations as the maternal. Our diploid assembly enabled us to discover a recent expansion of the sex-differentiation region and unique evolutionary changes in the marmoset Y chromosome. In addition, we identified many genes with signatures of positive selection that might have contributed to the evolution of Callithrix biological features. Brain-related genes were highly conserved between marmosets and humans, although several genes experienced lineage-specific copy number variations or diversifying selection, with implications for the use of marmosets as a model system.

Geometric deep learning enables 3D kinematic profiling across species and environments.

Comprehensive descriptions of animal behavior require precise three-dimensional (3D) measurements of whole-body movements. Although two-dimensional approaches can track visible landmarks in restrictive environments, performance drops in freely moving animals, due to occlusions and appearance changes. Therefore, we designed DANNCE to robustly track anatomical landmarks in 3D across species and behaviors. DANNCE uses projective geometry to construct inputs to a convolutional neural network that leverages learned 3D geometric reasoning. We trained and benchmarked DANNCE using a dataset of nearly seven million frames that relates color videos and rodent 3D poses. In rats and mice, DANNCE robustly tracked dozens of landmarks on the head, trunk, and limbs of freely moving animals in naturalistic settings. We extended DANNCE to datasets from rat pups, marmosets, and chickadees, and demonstrate quantitative profiling of behavioral lineage during development.

Neuroscience: A Face's Journey through Space and Time.

Faces are complex objects of great variety, which the visual brain somehow manages to organize by similarity. Two such orderings in fact exist and one, a new study finds, is transformed into the other over time, enhancing a face's distinctiveness.

The human endogenous attentional control network includes a ventro-temporal cortical node.

Endogenous attention is the cognitive function that selects the relevant pieces of sensory information to achieve goals and it is known to be controlled by dorsal fronto-parietal brain areas. Here we expand this notion by identifying a control attention area located in the temporal lobe. By combining a demanding behavioral paradigm with functional neuroimaging and diffusion tractography, we show that like fronto-parietal attentional areas, the human posterior inferotemporal cortex exhibits significant attentional modulatory activity. This area is functionally distinct from surrounding cortical areas, and is directly connected to parietal and frontal attentional regions. These results show that attentional control spans three cortical lobes and overarches large distances through fiber pathways that run orthogonally to the dominant anterior-posterior axes of sensory processing, thus suggesting a different organizing principle for cognitive control.

Social interaction networks in the primate brain.

Primate brains have evolved to understand and engage with their social world. Much about the structure of this world can be gleaned from social interactions. Circuits for the analysis of and participation in social interactions have now been mapped. Increased knowledge about their functional specializations and relative spatial locations promises to greatly improve the understanding of the functional organization of the primate social brain. Detailed electrophysiology, as in the case of the face-processing network, of local operations and functional interactions between areas is necessary to uncover neural mechanisms and computation principles of social cognition. New naturalistic behavioral paradigms, behavioral tracking, and new analytical approaches for parallel non-stationary data will be important components toward a neuroscientific theory of primates' interactive minds.

Face selective patches in marmoset frontal cortex.

In humans and macaque monkeys, socially relevant face processing is accomplished via a distributed functional network that includes specialized patches in frontal cortex. It is unclear whether a similar network exists in New World primates, who diverged ~35 million years from Old World primates. The common marmoset is a New World primate species ideally placed to address this question given their complex social repertoire. Here, we demonstrate the existence of a putative high-level face processing network in marmosets. Like Old World primates, marmosets show differential activation in anterior cingulate and lateral prefrontal cortices while they view socially relevant videos of marmoset faces. We corroborate the locations of these frontal regions by demonstrating functional and structural connectivity between these regions and temporal lobe face patches. Given the evolutionary separation between macaques and marmosets, our results suggest this frontal network specialized for social face processing predates the separation between Platyrrhini and Catarrhini.

Evaluation of Topical Lysostaphin as a Novel Treatment for Instrumented Rhesus Macaques (Macaca mulatta) Infected with Methicillin-Resistant Staphylococcus aureus.

Lytic enzymes are novel antimicrobial agents that degrade bacterial cell walls, resulting in cell rupture and death. We tested one enzyme, the bacteriocin lysostaphin, for treatment of nonhuman primates (Macaca mulatta) with persistent methicillinresistant Staphylococcus aureus (MRSA) infection of their cranial implant margins. The goal of this study was to determine if topical lysostaphin, either alone or as an adjunct therapy, could eliminate MRSA. Lysostaphin had in vitro lytic activity against all 4 previously identified NHP MRSA clones, as well as against 12 MRSA isolates of the same clonal type (MLST ST3862 and spa type t4167) before and after treatment, with no resistance discovered. In an in vivo pilot study, a 2-d application of lysostaphin alone reduced MRSA in the implant margins by 3-logs during treatment of one animal; however, MRSA titers had returned to control levels by 1 wk after treatment. In the main study, all animals (n = 4) received 10 d of systemic antibiotic treatment and both the animals and their environment (cages, equipment, room) underwent 5-d of decontamination. The experimental animals (n = 2) received 5 doses of topical lysostaphin (15 mg, every other day) applied onto their implant margins. Daily cultures showed that MRSA counts decreased significantly (≤ 25 colony-forming units/mL; P < 0.05). However, sampling of the cranial implant margin 7 d after last treatment showed that MRSA counts had returned to control levels. Our study suggests that lysostaphin, coupled with other treatment modalities, can decrease MRSA infection short-term but do not completely eradicate MRSA in the long-term. This reappearance of MRSA may be due to cross-contamination or reinfection from other infected areas, an inability of the treatment to reach all colonized areas, or insufficient dosing or length of treatment. Topical lysostaphin may be more useful clinically for superficial nonimplant associated wounds in which the lytic enzyme has better access to the infected tissue.

The neural mechanisms of face processing: cells, areas, networks, and models.

Since its discovery, the face-processing network in the brain of the macaque monkey has emerged as a model system that allowed for major neural mechanisms of face recognition to be identified - with implications for object recognition at large. Populations of face cells encode faces through broad tuning curves, whose shapes change over time. Face representations differ qualitatively across faces areas, and we not only understand the global organization of these specializations, but also some of the transformations between face areas, both feed-forward and feed-back, and the computational principles behind face representations and transformations. Facial information is combined with physical features and mnemonic features in extensions of the core network, which forms an early part of the primate social brain.

Interrogating an ICD-coded electronic health records database to characterize the epidemiology of prosopagnosia.

INTRODUCTION: Recognition of faces of family members, friends, and colleagues is an important skill essential for everyday life. Individuals affected by prosopagnosia (face blindness) have difficulty recognizing familiar individuals. The prevalence of prosopagnosia has been estimated to be as high as 3%. Prosopagnosia can severely impact the quality of life of those affected, and it has been suggested to co-occur with conditions such as depression and anxiety. METHODS: To determine real-world diagnostic frequency of prosopagnosia and the spectrum of its comorbidities, we utilized a large database of more than 7.5 million de-identified electronic health records (EHRs) from patients who received care at major academic health centers and Federally Qualified Health Centers in New York City. We designed a computable phenotype to search the database for diagnosed cases of prosopagnosia, revealing a total of n = 902 cases. In addition, data from a randomly sampled matched control population (n = 100,973) were drawn from the database for comparative analyses to study the condition's comorbidity landscape. Diagnostic frequency of prosopagnosia, epidemiological characteristics, and comorbidity landscape were assessed. RESULTS: We observed prosopagnosia diagnoses at a rate of 0.012% (12 per 100,000 individuals). We discovered elevated frequency of prosopagnosia diagnosis for individuals who carried certain comorbid conditions, such as personality disorder, depression, epilepsy, and anxiety. Moreover, prosopagnosia diagnoses increased with the number of comorbid conditions. CONCLUSIONS: Results from this study show a wide range of comorbidities and suggest that prosopagnosia is vastly underdiagnosed. Findings imply important clinical consequences for the diagnosis and management of prosopagnosia as well as its comorbid conditions.

Evidence for an attentional priority map in inferotemporal cortex.

From incoming sensory information, our brains make selections according to current behavioral goals. This process, selective attention, is controlled by parietal and frontal areas. Here, we show that another brain area, posterior inferotemporal cortex (PITd), also exhibits the defining properties of attentional control. We discovered this area with functional magnetic resonance imaging (fMRI) during an attentive motion discrimination task. Single-cell recordings from PITd revealed strong attentional modulation across 3 attention tasks yet no tuning to task-relevant stimulus features, like motion direction or color. Instead, PITd neurons closely tracked the subject's attention state and predicted upcoming errors of attentional selection. Furthermore, artificial electrical PITd stimulation controlled the location of attentional selection without altering feature discrimination. These are the defining properties of a feature-blind priority map encoding the locus of attention. Together, these results suggest area PITd, located strategically to gather information about object properties, as an attentional priority map.

Functionally defined white matter of the macaque monkey brain reveals a dorso-ventral attention network.

Classical studies of attention have identified areas of parietal and frontal cortex as sources of attentional control. Recently, a ventral region in the macaque temporal cortex, the posterior infero-temporal dorsal area PITd, has been suggested as a third attentional control area. This raises the question of whether and how spatially distant areas coordinate a joint focus of attention. Here we tested the hypothesis that parieto-frontal attention areas and PITd are directly interconnected. By combining functional MRI with ex-vivo high-resolution diffusion MRI, we found that PITd and dorsal attention areas are all directly connected through three specific fascicles. These results ascribe a new function, the communication of attention signals, to two known fiber-bundles, highlight the importance of vertical interactions across the two visual streams, and imply that the control of endogenous attention, hitherto thought to reside in macaque dorsal cortical areas, is exerted by a dorso-ventral network.

Resting state functional connectivity patterns associated with pharmacological treatment resistance in temporal lobe epilepsy.

There are no functional imaging based biomarkers for pharmacological treatment response in temporal lobe epilepsy (TLE). In this study, we investigated whether there is an association between resting state functional brain connectivity (RsFC) and seizure control in TLE. We screened a large database containing resting state functional magnetic resonance imaging (Rs-fMRI) data from 286 epilepsy patients. Patient medical records were screened for seizure characterization, EEG reports for lateralization and location of seizure foci to establish uniformity of seizure localization within patient groups. Rs-fMRI data from patients with well-controlled left TLE, patients with treatment-resistant left TLE, and healthy controls were analyzed. Healthy controls and cTLE showed similar functional connectivity patterns, whereas trTLE exhibited a significant bilateral decrease in thalamo-hippocampal functional connectivity. This work is the first to demonstrate differences in neural network connectivity between well-controlled and treatment-resistant TLE. These differences are spatially highly focused and suggest sites for the etiology and possibly treatment of TLE. Altered thalamo-hippocampal RsFC thus is a potential new biomarker for TLE treatment resistance.

Functional Networks for Social Communication in the Macaque Monkey.

All primates communicate. To dissect the neural circuits of social communication, we used fMRI to map non-human primate brain regions for social perception, second-person (interactive) social cognition, and orofacial movement generation. Face perception, second-person cognition, and face motor networks were largely non-overlapping and acted as distinct functional units rather than an integrated feedforward-processing pipeline. Whereas second-person context selectively engaged a region of medial prefrontal cortex, production of orofacial movements recruited distributed subcortical and cortical areas in medial and lateral frontal and insular cortex. These areas exhibited some specialization, but not dissociation, of function along the medio-lateral axis. Production of lipsmack movements recruited areas including putative homologs of Broca's area. These findings provide a new view of the neural architecture for social communication and suggest expressive orofacial movements generated by lateral premotor cortex as a putative evolutionary precursor to human speech.

Single neurons may encode simultaneous stimuli by switching between activity patterns.

How the brain preserves information about multiple simultaneous items is poorly understood. We report that single neurons can represent multiple stimuli by interleaving signals across time. We record single units in an auditory region, the inferior colliculus, while monkeys localize 1 or 2 simultaneous sounds. During dual-sound trials, we find that some neurons fluctuate between firing rates observed for each single sound, either on a whole-trial or on a sub-trial timescale. These fluctuations are correlated in pairs of neurons, can be predicted by the state of local field potentials prior to sound onset, and, in one monkey, can predict which sound will be reported first. We find corroborating evidence of fluctuating activity patterns in a separate dataset involving responses of inferotemporal cortex neurons to multiple visual stimuli. Alternation between activity patterns corresponding to each of multiple items may therefore be a general strategy to enhance the brain processing capacity, potentially linking such disparate phenomena as variable neural firing, neural oscillations, and limits in attentional/memory capacity.